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Abstract 

We investigate the problem of the existence of trajectories asymptotic 
to elliptic equilibria of Hamiltonian systems in the presence of resonances. 



1 Introduction 

In the recent Congress held in Saint Petersbourg, dedicated to the 50*'' anniver- 
sary of A.M. Lyapunov, the V.V. Kozlov conference [4] has been devoted to the 
so-called Lyapunov's First Method, applied in particular to the problem of the 
existence of O^-curves (resp. 0~-curves) that are integral curves asymptotic in 
the future (resp. in the past) to the equilibria of Lagrangian systems. This prob- 
lem is obviously related to the problem of the inversion of Dirichlet-Lagrange 
Theorem and the papers [5, 9] contain the first important results for analytic 
potential functions with degenerate critical point. We refer to [8] for a review 
on further researches in this subject. 

In the framework of Hamiltonian systems, a large number of papers have 
been devoted to the study of the relationship between instability (as well sta- 
bility) of equilibria and resonances. We quote here just some essential refer- 
ences [2,3,7,11]: in all these papers the instability was proved by constructing 
suitable Cetaev's functions. 

We were therefore stimulated to study, by means of the First Method, the 
existence of O-curves of Hamiltonian systems in the presence of resonances. The 
Hamiltonian function we consider is supposed to have a non degenerate elliptic 
fixed point F (see Section (2). The corresponding Birkhoff normal form turns 
out to be a perturbation of an integrable Hamiltonian function. Moreover the 
integrable system admits two distinct straight lines r± which are O^-curves. 
Following the russian terminology, these orbits are called "rays of the model 
system" . Their existence is the starting point to build up the Cetaev function 
for the complete Hamiltonian system (resonances of order 3 or 4 are considered 
in [3]). In Section [3] we prove that the complete Hamiltonian system admits 
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0-curvcs, that have as asymptotic direction one of the two rays of the model 
system. 

To prove this result we analyze the Hamiltonian system in a neighborhood 

of each ray. Then, by using a suitable set of variables wc build up a new dif- 
ferential system with a non degenerate hyperbolic equilibrium. According to 
the choice of the ray, the relationship between these two differential systems al- 
lows us to conclude that the local stable manifold of this hyperbolic equilibrium 
corresponds either to a family of O^-curves or to a family of 0~-curves of the 
Hamiltonian system. 

Before concluding, let us recall that the existence of O-curvcs was analyzed 
by Lyapunov in the case of analytic differential systems. Many results on this 
subject can be found in the book of Zubov [12]. In particular, in Chapter III, 
perturbations of homogeneous polynomial differential systems having rays are 
studied and O-curves are obtained as power series of the variable t~", a being a 
positive rational number depending on the degree of the homogeneous system. 
Moreover, in the general case, the coefficient of each term in the expansion is 
found to be a polynomial function of the variable log t. 

The Hamiltonian functions we consider here are just C functions (the in- 
teger r depending on the degree of the resonance) therefore we need to apply 
general hyperbolic theory, i.e. fixed point theorems in suitable functional spaces. 

In the case C°° the method of expansion in power series could still be used, 
at least at a formal level. In fact the existence of formal series representing 
O-curves is effective: a deep result by Kutsnesov [6] allows to conclude that 
there exist true O-curves having the formal series as asymptotic expansion. 

In conclusion, wc can repeat here the words one can read at the end of the 
introduction to Chapter III of the book of Zubov : "the basic ideas of almost 
all the results are in the works of Lyapunov" . 

2 Preliminaries 

We start by considering a Hamiltonian function H G C°°{Cl,R), O a domain in 
R^", containing the critical point a; = 0. Precisely, we assume that a; = is an 
elliptic critical point, and therefore we write 

H{x) = H^2]{x)+n{x), 

where 

n 

Ifp] {x) = ^ iViix'i + J, H{x) = 0{\xn 

We consider the case in which the quadratic form H^2] has non trivial zeros. 
Moreover we assume the following hypotheses. 

{Hi) There exists an integer iV > 3 such that, for any h = (h\,...,hn) € 
^;\{0}, \h\ ■■=Y:Uhi<N-l, 
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{H2) There exists a vector k, k E Z" \ {0}, |fc| ~ N, such that 

{LU,k) = 0. 

Moreover, if k' e {0,k} is such that (cj, fc') = then \k'\ > M := 

3N - 1. 

In other words we assume a unique direction of resonance along e := -jlj, up to 
order 3N. 

Under the previous hypotheses, by means of a symplectic change of variables 
X — y + ^{y) in a neighborhood of a; = 0, we obtain the Birkhoff form of the 
Hamiltonian [10], 

H^{i, e)^Y. (^) + HbXi, {d, k)) + 7^^(/, e), (2.1) 

where we also introduced the action-angle variables / = 6 = 
(&!,..., 6'„), with 

y, ^ y/WiCosei . 

/TTT - a I ^ I,. . . ,n. 

In (|2.ip we have: 

• iJj^j (/), j e {l, . . . , |iV}, is a homogeneous polynomial of degree j in the 
variables (/i, . . . , /„). In particular 

i/[f] = (w,/). 

• H^, the resonant term, takes the form 

N 



Hiii, {e,k)) = J2Hrii, {e,k)), 



r=0 

where, for r < iV — 1, 



k 

Hr = {^nlj. ^) + ^) } n ^^^'^ (2.2) 



jl + ...+jn=r a=l 



and 



+ ^jii^L cos 2(0, fc) + /ij-^f sin 2{0, fc) } n ^" 
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• TZ^{I,0) collects the higher order terms: 

7^^(/,0) = o(|/|^). 

We now make two further assumptions on the system. 
{H3) I = k is SL channel of instability, that is 

(Hi) Let * : M ^ M be defined by setting 

^ia):^Hf,^^{k)+Ho{k,kla), a €R, (2.3) 

with iJn „i and Hq as in (|2.f |) and (|2.2p respectively. We assume that "if 
has a simple zero at cr = c. 

Remark 2.1 The assumption {H3) is satisfied if iV < 4, otherwise it implies 
that Arnol'd condition of non degeneracy [1] is violated up to the order N. 

Remark 2.2 The general form of (|2.3p can be written 

*((t) ^ Acos[kf{a + ctq)] + B. 

The hypothesis {H4) implies that there exist two roots c± of "if such that 
\l/'(c+)*'(c_) < 0. Let *'(c+) > 0. Then the ray r+ (rcsp. r_) corresponds 
to c+ (resp. c_). Obviously, if N is odd then B — and therefore ^"(c±) = 
—kf'i>{c±) — 0. This fact will be exploited in Section [3l 

We are now able to state the main result of the paper. 

Theorem 2.3 Under Hypotheses {Hi), {H2), {H3), and {H4) the Hamiltonian 
system admits a (n — I) -parameters family of -curves as well as a (n — 1)- 
parameters family of -curves. 

The proof of the theorem is given in the next section. 
Remark 2.4 The theorem still hold if we assume H e C r = 3N + 1. 



3 Proof of Theorem [231 

Without loss of generality we may assume ki > 0. We then introduce the 
symplectic linear change of coordinates (1,0) {J,"^^) = [AiIjA^O) given by 

Ji = kih, Ja = kila - kail, a = 2, • • • , n, 

, {0,k) Qa „ 

Vi = —^, Va = -^, a = 2,---,n. 
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The Hamiltonian function K{J,ip) = H{A-^ ^J,A2 ^tp) then reads 

K{j, i,) = K{j) + J, v^i) + n{j, 

where 

3 JV 

K{J) = £i^y](J), i^y](J) = H^^iA^'j), 



JV 



r=0 

We next introduce the following notation for n-components vectors, 

X={XI,X), X = {X2, . . . ,Xn)- 

The Hamiltonian system then reads 

dK^{Ji,J,i;i) 57^(Jl,J,^l,V') 



(3.1) 



Ji 



J 



dipi 



Vl =f^l(Jl,J) + + ; 

5i^«(Ji, J,Vi) , 57^(Jl,J,Vl>) 



(3.2) 



= f^(Ji, J) + 



where 



fii(J) = ^, (1{J) 



dJ 

dK{J) 



dJi ' ' dJ 

We observe that, by virtue of Hypotheses {H3) and {H4,), since Aj"^(Ji,0) = 



f^i(Ji,0) 



ajr^(Ji,o,c) 



JV 



JV 



= E 



"^(^.0) + !:^^^^, (3.3) 



dJi 



r=l 



where 



and 



1/2 if TV is odd, 
1 if A'' is even. 



7:=?^(l,0,c)^0. 



(3.4) 
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For definiteness we consider the case 7 > 0; the case 7 < wih be briefly 
discussed at the end of the section. We look for solutions to (13.21) of the form 



Jiit) 
Jit) 

m 



{N ~2)t 
2 

{N -2)t 
2 



iV + 2 
iV-2 



{r + Mi(t)} 



{N -2)t 



25 

N-2 



Cl + C2 



[N -2)t 



2S 
N ~2 



(N ~2)t 



where 



r:=7- 



{Clo + vit)}, 



no 



(3.5) 



(W2, ■ • • ,Wn) 



A:i(A^- 2) 

and u{t) — {ui{t),u{t)), v{t) ~ {vi{t),v{t)) are such that 
lim u{t) = 0, lim v{t) = 0. 

t — 'OO t — *oo 

The explicit values of the parameters ci and C2 are given in Proposition 3.1 
below. We introduce the new independent variable z by setting 



{N~2)t_ 

and write the differential equations for the functions 

rj{z) := v{tiz)). 
This is the content of the following proposition. 
Proposition 3.1 Let, for N odd, 

2rT^ 5^Ii^l(1.0) 2T^ dKiil,0,c) 



(3.6) 



Cl 



iV + 1 



dJi 



Cl 



TV + 2 dJx 



and, for N even, 



Cl 



2rf r9%+i](i,o) ai^i(l,0,c) 



iV + 2 



dJi 



dJi 



C2 = 0. 



(3.7) 



(3.8) 
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The functions {^{z),r]{z)) are solutions to the differential system 
( d^i N-2 



dz 
dz 

drji 

' dz " 2 

df] N-2 



2 

A^ + 2 
N + 25 



^1 +doz + Ui{z,^,T]), 

i+U{z,^,v), 
rji +diz + d2^i +Vi{z,^,r]), 



(3.9) 



k ^'dz 



fj + dz + V{z,^,r]), 



where, for N odd, 



do 



N+2 dKi(lJ).c) kf 



r— 



i 2 



di = -r 2 L^_J ciT " 



dJi 



dJidtpi 



= ^-ip^ ^^^m^^'Q) ^^p-i iv(^-2) ^ 



dJi 



(3.10) 



and, for N even, 
do 



«+2 dKi{l,0,c) d^Ko{l, 0, c) 
i 2 — 1- Ci - 



di 



-r"2 +^ 



dJi 



dJi 



ciT 



Nd ^Ki{l,0,c) 
dJidtjji 



,4 2T-i^^-^o(l,0,c) 



+ ktciT— 



dJi 



N ._, dK^f+i]{m _ N{N-2) 
2 dJi ' 4 



Finally, for any N, 



d^T' 



/9if[2](l,0) axo(i,o,c) 



1 



dJ 



dj 



(3.11) 



(3.12) 



/n particular d = if N = 3. 

The functions U = {Ui,U) and V = {Vi,V) are functions in a "right 
neighborhood" A/'+ of zero in ]R^"+^, 

:= {(z,e,??) e m2"+i : z G [0,e), ||(^,r?)|| < e). 

Moreover the Jacobian matrices saMsfy 

DC/(0, 0, 0) = 0, W(0,0,0) = 0. 
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Proof. The proof is straightforward but cumbersome. Of course one has to 
rewrite the system p.2p in terms of the independent variable z and the unknowns 
(^,77), according to (|3.6p . The main point is then to extract from the r.h.s. of 
the system the Unear part and verify the regularity property of the remainder. 
By and ((^ we have 



Af + 2 ^ 



Ji = z(r + ei), 

whence, since z — —z^, 



-z--Ji=T + Ci+z^, 
dz 



Ipl = C + Z*(ci + C2Z^ + ?7i), 



(3.13) 



_jv ; iV + 2 jv " N+2 d£ 

-z 2 J — z 2 ^ + z 2 ^ 

2 dz 

-z'^^i = ci5z'-^ + 2c25z^'-^ + 6z'-^Tii + 

dz 



(3.14) 



By comparing ()3.9p and ()3.14|) it follows that 

C/i(z,^,77) = -z-^ji-r-y6-do^, ;7(z,e,r?) = -z-^J, (3.15) 



TV 



^1(2,^,77) = -z'-'-^^i - ciS-2c26z'' + —r]i - diz - daCi, 

A N -2 - 
Viz, t V) = ""0 H — ^0 ~ dz, 



(3.16) 
(3.17) 



where the time derivatives (J, V') are given by the r.h.s. of (j3.2p expressed in 
terms of the variables {z,^,r]) by means of (|3.13p . 

In the sequel we shall denote by AGCT" a generic function of {z, ^, 77) which 
vanishes with its first partial derivatives in (0,0,0). Since 



(fci,A:) + z^-(0,0 
fci 



recalling the definition of TZ in p.ip we have: 

97^(z(^ + ^i), z^?", c + yi(ci + cz^/i + 771), ($lo + 



^7^(z(^ + a), z~i, c + ^/i(cl + C2 yi + 771), z — ^ (r^o + 77)) 

dJ 



(3.18) 



z^AA/T, 
(3.19) 

z^UjCT. 



(3.20) 
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By the second equality in (|3.15p and (|3.19p we get tj = MCT . Moreover, by 
p.l7p . (|3.20p and the definition p.l2p of d it is straightforward to conclude also 
that V = Md 1 we omit the details. The analysis of the functions U\ and V\ is 
more delicate and the cases N odd and N even have to be treated separately. 

Case N odd. By Remark 12.21 we have 

^' a./.3 ~ '^1 



2 ^' f)J,3 



By the definitions (|3.ip . (|3.18p . and recalling (5 = -i in this case, 

+ C2y/z + 771)) 

dipi 

N dKo(T + ^i,z^i c + Vi(ci + C2^/^ + ?7i)) 

while, for r > 1, 



dKrizjT + ^i),z^i, c + VI(ci + caVi + 771)) 



_ Il+r dKr{T + ^l,Z2 ^, c+ Vz(ci +C2VI+??l)) 
Oljjl 

Then, recalhng the definitions ([33), (|3TT0| . and T = -y^iv^, 
TV 

= r+ y^i +doz+A/'/T. 

The previous expansions imply Ui — MCT . 
Analogously, recalling also (|3.3p . 



«^f g^[«+i](r + a,o) , ^ a2ifo(r + ei,o,c) 

V'l = 2 2 <^ h (ci + + 



9Ji dJid^i 

« 9j^i(r + a,o,c) , 2 ^ 9'i^o(r + $i,o,c) 
iv+i a^/i: (r + £1,0, c) iv+i ^-fs^rj^i (r + 6,0) 

dJid^i dJi 

+ z—Afcr, 
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whence 



1- JV 



w^_^, 52/^0(1,0, C) 
+ (c2\/2; + ?7i)(r + 



(9Ji9V'i 

g^j^l(l,0,c) ^_ iV + l^J^[jV + 3](l,0) 

+ z—ucr. 

On the other hand, by the exphcit form of the functions Kq, recaUing |fc| = iV 
and Remark 12.21 it is easy to verify that 



9^Xo(l,0,c) _ N dK^{l,Q,c) _ N d^^K^jl^Q.c) _ ^ dK^{l,Q,c) _ 
dJidiPi 2 aVi 2^' dJidil^f 1 dJi 

By inserting the previous expression of z^~4'i in (|3.16p . expanding up to the 
first order in the variable ^1, and recaUing the definitions (|3.7p . (|3.10p of ci, C2, 
di, and c?2, we get Vi = A/ilT. 

Case iV even. To prove C/i = AfCT we argue as before; the only difference is 
that 6 = 1 and C2 = in this case, so that 

dKo{z{r + Ci), z^e, c + z(ci + m j) 



whence the definition of do in (|3.1ip for N even. 
Wc finally have 

= — — ^^'^^"^^ — dj^i — 

H — hCi z ■ 



dJi ' '"^ dJidi^l 

dJid^i dJi 
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whence 



(r + a 



9ifr«+ii(l,0) 



-[f+ 

dJi 

ai^i(i,o,c) , 



-ci(r + a) 



^9^go(l,0,c) 
9Ji97/;i 



dJi 
a^JCi(l,0,c 
dJidipi 



dJidt/ji 

^a3ifo(i,o,c) 



dJidi^f 



By inserting the previous expression of z~~ipi in p.l6p . expanding up to the 
first order in the variable ^ i using that in this case we still have 



d^Koil,0,c) _ NdKoil,0,c) 



dJidtpi 



9^1 



TV d^Ko{l,0,c) _ axo(i,o,c) 



dJi 



and recalling the definitions (13. 8|) and p. lip of ci, C2, di, and ^2, we get Vi 

Mcr. 



□ 



System p.l4p is equivalent to the autonomous system: 



dz 

" 

da 
dr 

di 
dr ~ 

dr]i 
dr 

dfj 
d7 ' 



7V- 



-a - do2;- J7i(z,a?y), 



2 
2 

7V-2 



-e-f7(0,ar7), 



(3.21) 



r/i - diz - d2a - "^i(^,a^), 

fj-dz- y(z,a?7)- 



The origin (z,a?7) = (0,0,0) is an hyperbolic equilibrium. In order to apply 
the hyperbolic theory we have to get rid of the fact that the system is defined 
in A/""*" , and not in a full neighborhood of the origin. However the proof of the 
existence of the stable manifold can be easily adapted to this case. Then we 
have a local invariant stable manifold, parametrized by {z,^i,ri), which is the 
graph of a function defined in a neighborhood C A/""*" . 

In conclusion, coming back to the original variables we have obtained W'^, 
an (n — l)-dimensional surface of ©"'"-curves. 

We conclude this section by briefly considering the case 7 < 0. We consider 
the problem (|3.2p in the past, or equivalently, we change the sign of the Hamil- 
tonian function and let t > 0. In particular we replace 7 by I7I everywhere it 
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appears. We thus get again a system of the same form of (|3.2ip . In conclusion, 
to the stable manifold corresponds now W~ , an (n — l)-dimcnsional surface of 
0~-curves. 

Finally, recalling that we have two different rays of the model system, the 
proof of Theorem 12.31 is accomplished. 
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